Papers with Divergent Association Task
Building Japanese Creativity Benchmarks and Applying them to Enhance LLM Creativity (2025.acl-srw)
Copied to clipboard
| Challenge: | a recent study evaluated the creativity of large language models (LLMs) in Japanese based on a Torrance test of creative thinking . previous research on LLM creativity focused on English, but differences exist in how it manifests and is evaluated across languages and cultures. |
| Approach: | They construct three benchmarks to evaluate LLM creativity in Japanese . they use Japanese Creativity Questions (JCQ), Divergent Association Task (DAT) and Story Alteration Task (SAT) |
| Outcome: | The benchmarks evaluate the creativity of large language models (LLMs) in Japanese . the benchmarks are Japanese Creativity Questions (JCQ), Divergent Association Task (DAT), and Story Alteration Task (SAT). |
Beyond Divergent Creativity: A Human-Based Evaluation of Creativity in Large Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models are increasingly used in verbal creative tasks. |
| Approach: | They propose a divergent association task that focuses on novelty, ignoring appropriateness, a core component of creativity. |
| Outcome: | The proposed model scores are lower than baselines with no creative abilities, undermining its validity for model evaluation. |